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Douglas  C.  Reber 

Abstract:  Aspects  of  the  approximation  and  optimal  control  of  systems  governed 
by.  linear  retarded  nonautonomous  functional  differential  equations  (FDE)  are 
considered.  First,  certain  FDE  are  shown  to  be  equivalent  to  corresponding 
abstract  ordinary  differential  equations  (ODE).  Next,  it  is  demonstrated  that 
these  abstract  ODE  may  be  approximated  by  difference  equations  in  finite 
dimensional  spaces.  The  optimal  control  problem  for  systems  governed  by  FDE  is 
then  reduced  to  a sequence  of  mathematical  programming  problems.  Finally, 
numerical  results  for  two  examples  are  presented  and  discussed. 
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1.  Introduction 

Our  concern  in  this  investigation  is  with  the  approximation  and  optimal 
control  of  systems  governed  by  linear  retarded  nonautonomous  functional  differ- 
ential equations  (F'DE).  After  presenting  some  basic  properties  of  solutions  of 
FDE  in  section  2,  we  demonstrate  in  section  3 that  certain  FDE  are  equivalent  to 
corresponding  abstract  ordinary  differential  equations  (ODE).  This  equivalence 
leads  to  two  significant  results.  The  first  is  the  validity  of  a "variation  id 
constants"  representation  of  solutions  in  the  state  space  Rn  * L^-rjOjR11). 

(A  similar  result  was  obtained  by  Delfour  [7];  such  representations  in  the 
state  space  C(-r,0;Rn)  are  well  known  - see  Hale  [10,  p.  207].)  For  our 
purposes,  the  importance  of  this  observation  lies  in  the  fact  that  a compactness 
property  of  the  variation  of  constants  representation  also  obtains  for  the 
solution  map  of  FDE.  The  second  result  is  that  a finite  difference  technique, 
similar  to  those  used  in  the  field  of  partial  differential  equations,  may  be 
employed  to  approximate  solutions  of  FDE.  These  results  are  discussed  in 
sections  4 through  8. 

The  operator  theoretic  framework  for  the  approximation  of  solutions 
of  FDE  requires  an  investigation  of  sufficient  conditions  (known  as  the 
stability  and  consistency  conditions)  for  convergence  of  approximate  solutions 
to  the  true  solution.  Other,  more  routine  details  of  the  particular  scheme 
we  have  chosen  are  incorporated  in  the  definitions  and  interrelationships  of 
various  spaces.  The  scheme  itself  has  been  studied  by  Delfour  [7]  by  a more 
direct  approach.  One  objective,  therefore,  of  this  investiga tion  is  the  re- 
formulation of  an  existing  technique  in  such  a manner  that  certain  essential 


L J 


features  are  emphasized.  An  immediate  additional  benefit  is  that  more 
general  optimization  problems  than  those  considered  by  Delfour  [7]  (linear- 
quadratic)  are  seen  to  be  easily  handled. 
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The  finite  difference  technique  leads  naturally  to  the  definition  of 
a sequence  of  mathematical  programming  problems.  The  original  optimization 
problem  (i.e.  that  which  is  governed  by  a linear  FBF)  is  shown  in  sections 

9 and  10  to  be  the  "limit"  of  these  approximating  problems,  in  the  sense  that 
the  corresponding  optimal  controls,  payoffs  and  trajectories  all  converge. 

We  then  discuss  numerical  results  for  two  examples  in  sections  11 
through  13.  Standard  techniques  of  numerical  analysis  were  applied  in  each 
case  to  solve  the  approximating  problems.  The  first  example  was  chosen  for 
its  simplicity,  so  that  an  analytical  solution  would  be  readily  available; 
the  second  is  associated  with  a biochemical  process. 

Finally,  some  concluding  remarks  on  the  above  technique  are  made  in 
section  14. 

Most  of  the  notation  employed  is  standard.  In  particular,  given  p 1, 
a closed  interval  I and  a Banach  space  X,  the  symbol  L,^(I;X)  will  denote  the 
set  of  (equivalence  classes  of)  strongly  Lebesgue  measurable  functions 
f:  I X for  which  / ( f | ^ h (I;X)  is  made  into  a Banach  space  by  defin- 

ition of  the  usual  norm  |*|T  . The  Banach  space  of  continuous  functions  with 

J i 

P (1) 

the  supremum  norm  will  be  denoted  by  C(I;X).  W.  (I;X)  denotes  the  set  of 
absolutely  continuous  functions  from  I to  X whose  derivatives  are  in 
L2(I;X).  For  Banach  spaces  X,  Y the  symbols  fS?(X,Y),  .^(X)  will  represent 

the  usual  sets  of  continuous  linear  transformations  with  the  uniform 
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n n * n . • 

operator  topology.  The  spaces  R and  R will  he  endowed  with  the  euclidean 

and  spectral  norms,  respectively. 

Given  arbitrary  sets  G,  ft  with  G C 11,  define  ch(G,(()  as  the 

characteristic  function  of  G.  We  shall  assume  that  the  positive  integers 
m,  n,  k and  v,  the  positive  number  r and  the  numbers  a,  h with  b > a are 

I 

fixed.  For  a function  f defined  on  [a-r,b]  and  t Gfaib],  the  function  f will 
be  defined  on  [-r,0]  by  f (0)  = f(t+0).  The  symbol  A will  denote  the  set 
{(t,s):  a<s<t<b}. 

Several  results  are  stated  without  proof  in  the  sequel;  unless  otherwise 
indicated,  proofs  may  be  found  in  Reber  [15], 

The  author  wishes  to  express  his  appreciation  for  the  helpful  comments  and 
suggestions  of  Professor  H.  T.  Banks. 

2.  The  Initial  Value  Problem 

For  the  moment,  consider  an  FDE  as  an  equation  which  relates  the  deriva- 
tive of  a function  x:  [a-r,b]  R1  at  time  t 6 [a,b]  to  'he  values  of  a given 
function  f and  an  operator  I.(t,')  acting  on  x(  as  an  element  of  h^.  Thus  we 
write 

x(t)  = L(t,xt)  + f(t) 

(x(a),xa)  = (n,f). 

It  might  appear  that  some  simple  FPL'  may  riot  he  formulated  in  this  way. 

For  example,  consider  >:(t)  = e(t)x(t-l)  with  e G f.^(a,h;R).  The  difficulty 
lies  in  the  fact  that  for  a given  (t,<H  G [a,b}*L  the  value  e(t)<J>(t-l)  is 


not  well  defined.  This  is  merely  an  inconvenience,  since  we  may  reformulate 
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the  problem  as 


L 

x(t)  = n + | [LCsjX^)  + F(s)]ds, 


x = <J) 
a 


just  as  is  done  for  ODE  satisfying  the  Cara  t hoodorv  conditions. 

Several  preliminary  definitions  are  r>v|i|'i<d  In  d riho  ' lie  EDI'  under 
consideration.  Let  the  Banach  spaces  Z,  A,  E and  I'  he  given  by 


Z = Rn  x L2(-r,0;Rn) 


A = L (a,b;(X  RnXn)  * I.  (-r,0;Rn*n) ) , 
0 


E = C(a,b;Z)  and 


F = L2(a,b;R'  ). 


A generic  element  of  Z will  be  denoted  by  r - (r,  ,t).  The  norms  of  Z 
v 

and  (X  Rn><n)xL2(-r,0;Rn  n)  are  the  usual  norms  for  product  spaces.  A 
0 

generic  element  of  A will  be  denoted  by  A = ( A^ , . . . ,A ^ ,D ) ; the  com- 
ponents A , . . . ,A  may  be  considered  elements  of  L2(a,b;Rn  n)  and  the 
component  D may  be  considered  an  element  of  L^i [a,bl*[-r ,0];  Rn  n). 

Let  VI  denote  the  subset 


W = f(n,*)GZ:  * 6 v , n^(o)}. 


Now  define  the  operator  L:  ra,b]*L2(-r,0;Rn)*A  k R ' by 


u 

L(t,*)  = L(t,*,A)  = l A.(tH(-T.)  + I 

n ' 1 ' 


D(  t ,n  )<f>(9  )dn 
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where  0 = t0  < . . . < = r end  X = (A  ,...,A  ,D).  Wo  remark  that  although  in 

a strict  sense  L is  not  well  defined  (point  evaluations  of  X and  <f>  are  required), 
no  problem  is  encountered  because  these  terms  will  appear  under  an  integral 
sign  in  our  usage  below. 

Thus  we  consider  FDF  of  the  form 

x(t)  = I,(t,x  ,A)  + f(< ) (7.1) 

with  (A,f)G  A*F  and  initial  value 

(x(s),xg)  = C G Z,  s G [a,bj  fixed.  (2.2) 

A function  x is  a solution  of  the  initial  value  problem  (IVP)  given  in  equa- 
tions (2.1),  (2.2)  if:  xG  W^^s.b;!*11)  , x satisfies  equa  t i on(  2 • 1 ) almost 
everywhere  in  [s,b]  and  (x(r.),xo)  satisfies  equation  (2.2).  (For  convenience, 
when  s = b define  a solution  of  the  IVP  in  the  obvious  way.)  Our  discussion 
will  concern  only  this  restricted  class  of  FDE. 

We  now  describe  some  properties  of  solutions  of  equations  (2.1),  (2.2). 

2.1  Theorem.  There  is_  a unique  solution  of  equations  (2.1),  (2.2)  which 
depends  continuously  on  Y = (s,c,X,f)  in  the  sense  that  the  map  (t,Y)  -*• 

(x( t;Y) ,xf( Y))  is  continuous  on  6xZ*AxF 


into  Z. 
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Define  the  operator  V:  A*A*Z  -+  Z by  V(t,s  ,X)a  = (x(t  ;s , £ , A ,0) , 
xt(s,^,X,0)).  One  may  easily  see  from  the  above  that  V is  contin- 
uous and  is  linear  in  t;  for  fixed  (t,s,X).  Therefore,  whenever  B C A is 
relatively  compact,  there  is, by  the  uniform  boundedness  principle,  a constant 
M (depending  on  B)  such  that  sup{  | V(  t ,s  ,X  ) } '•  (t,s,X)  G AxB}  <_  M. 

Uniqueness  of  solutions  of  the  I VP  implies  that  V(t,s)'  = V(t,T)V(t,s)  and 
V(s,s)  = I for  all  a <_  s < r < I < b.  Ii  is  easily  verified  that  V ( 1. ,r-,X) 
takes  W into  itself  for  all  (t,s,X)  G AxA. 

V/hen  dealing  with  linear  ODF.  in  Rn , the  variation  of  constants  formula 
provides  a very  useful  explicit  representation  of  solutions.  The  map  V 
defined  below  retains  the  form  of  this  expression;  that  it  indeed  represents 
a solution  of  FDE,  and  in  what  sense,  will  be  demonstrated  in  the  next  sec- 
tion. 

Let  t:  Z*AxF  -*■  E be  given  by 

t 

f)(t)  = v(t,a,X)q  + jv(t,s,X)(f(s),0)ds. 

a 

The  existence  of  the  integral  in  Z is  assured  by  the  uniform  boundedness  of 
V over  Ax{X}  and  the  strong  measurability  of  the  mar  s k V(  1:,s  ,X  )(f(s)  ,0). 

Now  define  z:  ZxAxF  ->  E 

z(c,X,f)(t)  = (x(t,a,c,X,f),  xt(a,?,X,f)>. 


We  list  some  properties  of  the  functions  z and  41  which  will  be  of 
interest  later  (e.g.  in  the  proof  of  Theorem  3.14). 


2.2  Lemma . The  functions  z and  T from  7.x A*F  to  E are  continuous. 
Furthermore,  for  each  fixed  U,X)  the  map  f -*  T(  x,  ,X  ,f ) is  affine  and 
compact. 


3.  Equivalence  of  FDE  and  abstract  PPL  , 

In  this  section  we  shall  establish  a relationship  between  solutions  of 
certain  FDE  and  solutions  of  corresponding  abstract  ODE  in  the  space  Z. 

For  this  part  of  our  discussion  we  will  require  that  X be  contained  in  a 
proper  subset  of  A.  Therefore,  define  the  set 


A = C.(a,b;(X  RnVn)xL,  (-r,0;  Rn*n)) 

c 1 o 2 


of  continuously  differentiable  functions  on  [a,b].  Define  a norm  on  by 

v 

|x|  ” 1 |A.|  + | D | , where  each  A.  is  considered  an  element  of  C(a,b;  Rn  n) 

C 0 1 C C -1 

and  D is  considered  an  element  of  C(a,b;  L (-r,0;  Fnn)). 


It  is  not  difficult  to  see  T®  , lemma  19,  p.  298]  that  for  a separable 


Banach 


space  X,  C^(a,b;  X)  is  dense  in  L^(a,b;X).  T 


hus  A is  dense  in  A. 


The  following  lemma  is  given  for  reference;  its  proof  follows  from 


Theorem  2.1. 


3. 1 Lemma  Suppose  y - ( r, , \ ,f ) F WxA xr.  Then  1 he  f unci  ion  (i  ,s  ) -*•  x^(s  ,y  ) 
F C(-r,0;  Rn)  is  continuous  on  A.  Here  over , the  function  (i,s)  -►  L(t,xt(s,y)) 
is  continuous  on  A for  y F WxA  xp. 
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Let  [a,b]>-A^xVJ  ■*  7,  be  given  by  cy(  t ) ( i/i( 0 ) ,t|/ ) = ^(  1 ;X  )( iJ/(0 ) ,ijj)  = 

(L(t,iJ>,X),  i|i).  Consider  the  initial  value  problem 

y(t)  -s/(  t;X)y(  t ) l E[s,b],  ?6  Ca,b]  fixed,  (3.1) 

I. 

y(s)  = r,  E W.  (3.9) 

A solution  of  equa  t ions  ( 3. 1 ) , ( 3. 2)  on  [s,b]  is  a continuous  function 
y:  [s,b]  -*  W which  satisfies  equal  ion (3.1 )on  |s,b]  (one-sided  derivatives  to 
be  taken  at  the  endpoints)  and  is  such  that  y(s)  = K,.  (For  convenience, 

when  s = b define  a solution  of  the  IVP  in  the  obvious  way.) 

The  following  definition  is  essentially  that  which  appears  in  Krein 
[11,  p. 193]. 


3.2  Definition  The  IVP  given  in  equations  (3.1),  (3.2)  is  uniformly 
correct  if: 

i)  for  each  se[a,b]  and  r,  E W there  is  a unique  solution  of  the  IVP, 

ii)  each  solution  y(t,s,5,X)  and  its  derivative  v(  t ,s  , Z, , X ) are  con- 

tinuous for  (t,s)E  A and  fixed  (t,A),  and 

iii)  the  solution  depends  continuously  on  the  initial  data  in  the  sense 

that  if  c.  E W and  K.  ■*  11  then  the  corr  ■ spend  i ng  solutions  con- 
x 1 

verge  to  zero  uniformly  relative  to  (t,s)  E A. 


3.  3 Lemma  Given  X G A , there  is  an  eguiva lonl  inner  product:  topology  on 
Z and  a positive  iu  ~ w(X)  such  that:  _Cj?H  t ; X )-m(  X ) I is  maxima)  dissipative  for 
each  t G [ a , b ] . 

Remark  The  idea  of  redefining  the  inner  product  is  related  to  similar  defini- 
tions in  [3]  anl  i.18  1.  This  and  the  following  lemma  are  required  for  the 
proof  of  Theorem  3.5. 


Proof  Define  = Rn  * L^C-r,©; Rn)  with  inner  product  <•,•>  , where 


<(n,<f’),(a,i|>)>  = <n,a>  + V 8 . 

A Rn  i 3 


< .f. f 0 ) ,<|,(0)  ••  dO 

t'  * * 


v 

8.  = 1 + 7 I A.  I „ It  is  easy 
d . “ . 1 r c 


to  3ee  that. 


I ( n, <l>)  |7  1 | ( n , 4> ) | x |(n,  i>)  |7, 


so  the  topologies  are  equivalent. 

If  ( n j , <#> j ) -t  (n,<f)  and  t )( n . ,4> . ) -*■  (a,'!')  then: 

i)  if.  -*■  and  ->  ij>  in  L imply  that 
I 1 0 ' 

<p(G)  = -HO)  t f'li(a)da  and  if, . -*■  $ in  C(-r,0;Rn),  and 
0 1 

n 

ii)  n . ■*  n in  R implies  that  HO)  = n . 

I 


So  (n,4>)€rW.  Furthermore  Sjf(  t ) C n , 4.  . ) a-  cjH  t ) ( n , ) , i.o.  t ) is  closed. 

Let  w(A)  = 1 + | X | . To  see  that  _llHt)-ii)I  is  dissipative  on  its  domain 


W: 
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u 

<_Q/t t)(n ,((>), (n )>.  = j[<ri,A  .( t)<fr(-T . )>  + ^n,  D(«  ,o)<(>(o )cl6> 

A 6 3 1 Rn  1 r" 


E 3, 


n-i 


] J J 


-T  . 
1 


-r 


<<Ke),<f.(o)>  rin 

Rn 


< f|A  (t)|  + (l/2)[|A  .(t)|]|n|?  + (l/?)[|A.(t)|U(-T.)|: 

1 J , J J 


\) 

(1/2)|d(i  )|  |n|?+(l/2)||)(  I )|  | + | \(  1/2)}Ja  .|  | n | ? 


! C 


- + ( 1/2 ) | n | ? - ( 1/2)  | i>(-r)  | ' 

i 1 ^ 3 


< C(.l/2)(  3+|D|  )+][|A  | ] In  | t (l/2)|n|  Ul 
c 0 ] 


< ( | > 1 + i/2)|(n,*)|? 

— C A 

= ( uj  - l/2)|(n,*)|xt 


o 2 

where  we  have  repeatedly  used  the  inequality  cd  (i/2)(c  +d). 

It  remains  to  show  that  _cy(t)-(ul  is  onto,  which  wilt  establish  maximal 
dissipativeness.  Fix  in  Z.  Let  4 G be  a solution  of  the  nnb  <t>— cu<t>  - ♦;  iti 

ticular  let  4>(n)  = e'‘^<t<(0)  + JoU)^  ' V(s)ds.  Clourlv  ( if>(0 ) ) G we  need 

0 

only  demonstrate  that  <t(n)  £ Rn  may  hr  chosen  so  that  L(t,*)  -co^(O)  = a. 

Write 

0 

v f 

L( t , <J> , X ) = l A.(t)*(-T.)  + D(t,e)(>(0)d0 

o 1 1 ! 

-r 

as  H(tH(0)  +G(t,t)i),  where 


par- 
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V [ n 

H(t)  = [e  ^A.(t)  * 1 e D(t  ,0)d0  , 


G [ 

n ■ J 


j w(-T.-s) 
e ■ i/j  ( s ) ds  + 


U V 

| n(i,o)  jr 


<l)(  0-S  ) 


j’  ( ) fir;  dO . 


The  equation  L(  t , f )-(iu}>(  0 ) = a has  a solution  if  H ( • ) — /n  f is  invertible, 
i.e.  if  (ll(  t)-ujT  )f(n)  = rt-G(i,>|>)  has  a sc  1 a t i nn . 1 tbs • rve  i |vi  i 


Nt>l  < Zt*jlc  *|J  e5”V>)'/2|D< 


I In. 


since  (f  e^^dO)^^  = t ( 1 /2(»i ) ( 1 - o ^wr)]l/'  < | py  choice  of  oj  - 1 + | X | > 

1.  Consequently  (H(t)-«I)  exists  and  has  norm  no  greater  than  one.  Hence 
.Cj^i t )-wI  is  onto.  //// 


-2ior , ,1/2 


3.4  Lemma  | f ) - n I ) . < (li  - w t 1/2)  for  all  u > u(>). 

3<zx)  - 

Proof  Suppose  r,  G W and  u > w.  Let  £ = Lo/(  t )-qiI  K.  Then 


= -<  <Y(i  )t,  r>  + n<r,  ,r> 


So  -<£,<;>  >_  (u  - a)  + \/7)<r.yr,  - y Since  <_  I r ( ^ • I A we  l,jve 
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Ulx  < (U  - u + = (m-»  + 

Therefore  | (_Q^(t  )-pI ) ^ I % ^ _<  (p  - (o  + 1/2)  \ //// 

X ■'/ 

The  following  theorem  will  enable  us  to  conclude  that  solutions  of  the  I V 1’ 
(3.1),  (3.2)  (if  they  exist.)  are  unique  and  depend  continuously  on  the  initial 
data  in  the  sense  of  part  (iii)  of  Definition  3.2.  The  basic  idea  of  the 
proof  may  be  found  in  Krein  [11,  p.204], 

3.5  Theorem  Every  solution  y _of  equations  (3.1),  (3.2)  satisfies  the  in- 
equality 

!y(t) | < n(»)o"(x>(t-s)p|  , 

i->  LI 

V . 

where  M(X)  = (1  t \ |A . | ) 

1 1 c 

Proof  We  again  find  it  convenient  to  use  <*,*>.  Hv  'he  definitions  of 
derivative  in  7,  and  of  i solution  of  the  IVP, 

(y(ttr.  ,s)  - y(t,s))/e  ► t )y(  t ) 


as  e + 0,  Hence 


I 
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y(t+E,s)  = [1  t e.C^T  t: ) ly(  t ,s  ) + o(e) 

= [I  - t)][  I - Ejy(t)l  \(t,s)  + o(e) 

= [I  - cJ*U)l  'y(t,s)  - e‘L9^(t)lI  - rjj/’ft)]  '.£/(' )y(  t ,s ) + o(c). 
In  view  of  Lemma  3.4,  for  1/e  > <o(  X ) we  have 

\u  - E_£/(orli^(z } = ( i/ r. ) | c( i/e ) r - ^(or’i^(7i  } 

.X  X 

< ( 1/c)[(1/e)  - ml"1 
= 1 + Ed)  + o(e). 


Thus 

|y(t+E  ,s)|  x <_  |y(t  ,s)|  x(1+e(d)+e| flf(t)[(  ,1/e  )I-qA  t ) .1  \q/(  t )y(  t ,s)| x+o(e). 

Since  _£J?(t)-toI  is  maximal  dissipative,  v.’c  may  apply  a resu’t  of  Pazy 
[ 14,  Lemma  3.2,  p.  10]  lo  conclude  that  for  all  w (F  7,, 

(1/e  )([«)+( 1/r.  )]I  - _Q^(t))  'w  ■+  w as  e l 0. 

This  implies  that  u[|i I-_Q^( t ) J 'w  -►  w as  p > «'  (mul  tiply  both  sides  by  1 + ew; 
let  p = (1/e)  + to) • For  1/e  > to  we  have 

(l/E)[(l/e)I-^(t)r'w  - w = _c/(t)L(]/e)I-ja^C  )]“’w. 

Therefore  _Q^(  t )T(  1 /e  t ) ] 'w  ■»  0 as  r l n for  all  w G 7.,  and  so 


t 


( |y(t+e,s)|  - |y(l,s)|  )/e  <_  u|y(t  ,s)  | . + 0(r ) + o(r  )/r. 


for  all  e with  1/e  > w.  Hence 


D+|y(t,s)|  <_  u)|y(t,s)[ 


where  D+  indicates  the  upper  right  derivative 


If  f EC(s,t;R),  then  (see  1.19,  pp.  ?39,?'t0l)  !)'f(n)  ^0  on  [s,t]  impli-v 
that  f(t)  _>  f(s).  In  particular,  for  f(0)  = -c  ° ^ ^ |y(0,s)|A  we  find  that 


|y(t,s)|A  <_  e'J'(X)(t_  ,)|y(s,s)|x,  i.e. 
|y(t,s)|z  <_  M(A)ew(>^t  s)Ulz- 


Several  more  lemmas  are  required  to  establish  the  relationship  between  FDE 
and  abstract  ODE.  The  proof  of  the  following  result  follows  a standard 
argument  (see  [19,  p.239]);  we  state  it  here  for  sake  of  completeness. 


3.6  Lemma . Suppose  X is  a Banach  space.  Let  x £C(a,b;X) 

be  such  that  x+(t)  exists  and  is_  continuous  on  [a,b).  Then  x(  t ) exists  on 
[a,b]  (one-sided  derivatives  to  be  taken  at  a , b)  and 


x ( t ) = x(a ) + 


)d."  = x(a)  + 


1 


for  all  t [a,b  ]. 
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3 V 

3.7  Lemma  ( 1 ) For  every  1 F ^ and  s G [ a ,b)  the  derivative  g-^-(  t ,s ) 5 

exists  in  Z for  t G [s  ,b]  and  egu  a Is  _o/f  t )V(  1 ,s )t,  if  £ G W. 

(2)  Similarly , if  t G (a,b  | and  r,  G W,  the  derivative 

3V 

-^<t,s)i;  exists  in  Z for  sG  [n,t]  and  equals  -V(  t ,slcy'(s)r,. 

(One-sided  derivatives  are_ to  be  taken  at  the  endpoints . ) 

3+ 

Proof  (l)  We  first  show  that  for  s G[a,b),  — V(  t ,s ) r I exists  if 
' 3 1 1 1 -s 

c e w. 

Suppose  ( n , >t> ) = r,  G W,  Then  Lemma  3.1  implies  that 
s+e 

(l/e)|  L(  0 ,xfj  )d0  LCSjX^) 
s 

as  e 1 0.  It  is  an  elementary  fact  (see  (9  , p.  254])  that,  x G L^(s-r,b) 

implies  (l/e)(x  -x  ) -►  (x)  in  L„(-r,0)  as  c 1 0- 
stp  s s 2 

Using  the  fact  that  r,  G W,  the  definitions  of  c/(  t ) and  V(t,s),  and 
Lemma  3.1,  we  may  conclude  that  the  function  t:  > sVX  t )V(  t ,s  )t  is  continuous 

on  [s,h).  Hence  the  function  t -*•  V(t;,s)r,  is  continuously  right  differentiable 

1 

on  Cs,b).  Therefore  , Lemma  3. 6 imp  lies  that  V(i,s)r,  = r + / c/(0 )V(0 ,s )£d0  for 
all  t G [s,bl,  and  thus  the  desired  conclusion. 

(2)  Fix  t G(a,bl.  Then  for  s € la,'),  r '•  0 sufficiently  small, 
and  r,  G W we  have 

(l/c)r.V(t,s+E)-V(  t , s ) 1 r = -V(  t ,S+r  )(  1/r  )|  V(str  ,s)-l  It. 

The  limit  of  the  right-hand  side  as  e • 9 is  -V(  1 ,s ) cy(  - )r,  (by  the  results 
of  part  (1),  the  uniform  boundedness  of  V(t,s)  over  A and  the  continuity  of 
s -*•  V(t,s)w  for  all  v;  G Z). 

The  strong  continuity  of  jy(s)  over  W and  the  uniform  boundedness  of 
V(t,s)  over  A imply  that  the  function  s ► -V(  t ,s ) <y(s  )r,  is  continuous. 
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Therefore,  we  may  again  use  Lemma  3.6  to  conclude  that  for  s £ [a,t], 

t 

V(t,s)r,  = x,  + Jv(  t,o)_c/(o)tda.  UH 

s 

Part  (1)  of  the  above  lemma  is  also  true  as  an  "only  if"  statement  - 
for  details,  see  [15]. 

We  may  now  relate  the  solutions  of  equations  (3.1),  (3.2)  to  those  of 
equations  (2.1),  (2.2)  when  f ~ 0. 

3.8  Theorem  For  1 £ A^  and  r,  £ W,  V(*,s,A)C  is  the  unique  solution  of 
equations  ( 3 . 1 ) , ( 3 . 2 ). Furthermore,  this  IVP  js  uniformly  correct. 

Proof  Theorem  3.5  and  Lemma  3.7  imply  that  V(*,s,>)c  is  the  unique 
solution  of  equations  (3.1) , (3.2).  Uniform  correctness  then  follows 
immediately  from  Lemma  3.1  and  the  corresponding  properties  of  solutions 
of  equations  (2.1),  (2.2).  //// 

We  turn  now  to  the  inhomogeneous  case.  Thus  we  consider  the  IVP 


y(t)  = jj/(t)y(t)  + g(t). 


y(s)  = t £W,  s € [a,b]  fixed 


(3.3) 


(3.4) 


While  equations  (3.3),  (3.4)  represent  the  problem  we  wish  to  solve, 

technical  considerations  (to  be  discussed  below)  require  some  slight 

modifications.  In  particular,  for  s as  in  equation  (3.4)  and  m = m(A)  , 

define  Q^(t)  =_q^(  ‘ ) - ml  and  g (t)  = ew^s  ^g(t).  We  shall  consider 
m w 

the  IVP  given  by  equation  (3.4)  and 
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v(t)  =J3^(t)y(t)  t g (t). 


(3.5) 


For 

that  will 


operators  U(t,s):  7.  + 7,  defined  for  (t,s)£  A we 
be  discussed  in  the  sequel  (see  L 11.  p.  115]): 


list  properties 


1°.  the  operator  U(t,s)  is  bounded  on  7.  uniformly  relative  to 

I 

(t,s)  £ A; 

2°.  the  operator  n(t,s)  is  strongly  continuous  in  (t,s)  on  A; 

3°.  U(t,s)  = U(  t,T  )U(t  ,s  ) , U(s,s)  = I for  a _<  s _<  r <_  t <_  b; 

4°.  i)  the  operator  U(t,s)  maps  W into  itself, 

ii)  the  operator  _cj^(  t )U(  t ,s  )_Q^  1 f s ) is  bounded  and  strongly 

continuous  on  7.  for  (t,s)£  A; 

5°.  on  V)  the  operator  U(t,s)  is  strongly  differentiable  relative 
to  t and  s,  with  -j-—  U(t,s)£  = SV( 1 :)U(  t ,s  ) r,  and  ^ — U(.t,s)C  = 

dr  (a)  d S 

-U(  t ,s  )£#{  s ) £. 

0) 


In  addition  to  the  hypotheses  listed  in  Lemma  3.9  below,  there  is  a 

standing  assumption  in  Krein  0.1  , p.  195]  under  wti ich  this  lemma  is  proved. 

In  particular  he  assumes  (as  we  also  do)  that  cy(t)  has  a bounded  inverse 
1 co 

satisfying  sup{  \.S&£ 3 )_Qf  ' (s ) | : s £ [a,b]}  < *.  This  requirement  is  treated 
in  Lemmas  3.10  and  3.11.  The  proof  of  Lemma  3.9  may  be  found  in  Krein 
[11,  Theorem  3.3,  p.  197], 


3.9  Lemma  If,  in  addition  to  the  above  assumption,  we  have: 

a)  the  I VP  given  by  equation  (3.4)  and  the  homogeneous 
part  of  equation  (3.5)  i_s^  uniformly  correct  j 


^ = e 1 ^g(t)  _is  continuously  differentiable , 


t 

then  y(t)  = J U(  t ,s  )g(s  )ds  yields  a solution  of  equation  (3.5)  with  initial 

a ' w 

value  zero  at  t = a . 

Clearly  e"’^  ’ ^ ^ y ( t ) is  a solution  of:  equations  (3.4),  (3.5)  if 
and  only  if  y(t)  is  a solution  of  equations  (3.3),  (3.4).  Therefore, 
the  homogeneous  part  of  equation  (3.5)  is  uniformly  correct,  and  its  solution 
operator  is  given  by  V^(t,s)  = ew*'S  tV(t,s). 

From  our  previous  results,  it  is  not  difficult  to  see  that  V^(t,s) 
satisfies  properties  l°-3°,  4°(i),  5°  and  that  is  strongly 

continuously  differentiable  on  W for  t £[a,bl  whenever  X £ A . 

3,10  Lemma  (cf.  Krein  ( ll,  pp.  176,  177])  Condition  4°(ii)  obtains  if 
zero  is_  a regular  point  of  (t  ) for  all  t £ fa,b]  and 
K = sup{  |c/U)_Q^1(t)  | ^(Z):  ^t<b}  is  finite. 

Proof  Write  _C/(  t )V(  t ,s  )SV  1 ( s ) as  [S*i  t)V(t,s)cy  1 ( a)  ][_cy(a  ) SV  ' ( s ) ].  The 

“WCO  0)  0)  0 ) CO  (o 

map  (t,s)  -*•  .£]/(  t )V(  t ,s ) is  stronglv  continuous  on  W (this  mav  be  established 

(DO)  • 

as  in  the  proof  of  Lemma  3.7,  part  (1)). Hence  (t.s)  -*■  0f(  t )V(  t ,s  )_Q^  ^(a)  is 

strongly  continuous  on  7.  For  each  fixed  0,s),  cy(  t )V(  t ,s  Ky_  1 ( i ) is  a 

0)  (0  0) 

closed  linear  operator  defined  on  all  of  therefore  it  is  bounded  by  the 
closed  graph  theorem.  Strong  continuity  with  respect  to  (t,s)  and  compact- 
ness of  A imply  by  the  Ranacb-Ste inhaus  theorem  that  the  operators 
a)  are  uniformly  bounded. 


For  t,t+o  £ [a,b]  and  any  r,  £ 7,  we  have 
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a)_Qf£  (t+o)C-.<$f(a).»£  (tk| 


a ).cfU  t+o ) t^t)- c/^t+a ) Jfl^1  ( t ) ? | 


< K.|  Lc/(t  )-.£/( t+0  ) .)_£/  <■  t > c | - 
— ai  a)  w 

The  right-hand  side  goes  to  zero  -is  o 4 0 by  t lie  strong  cont  inuity  of  _o/(t) 

0) 

on  W.  The  conclusion  follows  immediately.  I III 

We  now  show  that  the  second  hypothesis  of  Lemma  3'ilO  is  satisfied  for 
the  operators  Jjf  (t).  (Lemma  3.3  shows  that  the  first,  hypothesis  is  satisfied  by 
_Q^  ( * ) • ) These  operators  were  introduced  because  the  operators  s^( t)  do  not 
necessarily  satisfy  a corresponding  hypothesis. 


3,11  Lemma  There  is  a constant  K such  t hat  . |jtfa)j*“1(t)| 

a)  to 

t G [a,b]. 


Proof  We  may  write 


*(Z,  i K fer 


(_af(al-wl)(j3^(t)-ml ) ^ = e + e^, 


where  = [ of(  a )-_q/(  t )]  ( Qf'(  t )-<oI ) 1 and  = <fj/(  t )-«I  )(.Qf(  t )-mI )“ 1 = I. 
For  C n , (#> ) G W, 

|[_Q/(a)-_c/(  t)1(n,f)|7  - 1 1.(  a , f )-L(  t , <f ) | n 2p  | \ | ,.|f|r 
1/2 

where  P = max{l,r  }.  From  the  proof  of  Lemma  3.3  when(n,if)  = 
(Q^(t)-iol)  (rt, if)  we  have  | <H  c | i>(0)|+r  ' ' 1 1/'|  ( and 

I n | 1 |(H(t)-,nI)“1  | | rt-G(  t-,.|,)|  <_  | a | + | G ( t , i[i  ) | . 
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Observe  that 

|G(t,*)|  1 Z|  A | r 1/2|  .|.|  t I D | r | -!•  | 

0 1 2 2 

< r1/2p|x|c|t| 

I 

I / ^ 

Thus  | n | <_  | a | + r p | X | |']>|  . Consequently 

C 2 

Ulcl  M + rl/?(l+p  | X I c ) I lb  I L <_  d | ( e, , i|j  ) | z 

I /o 

where  d = 2[1  + r ( p | X I +])].  So  | e ..  I < o I x I pd;  therefore 

c 1&(Z)  - 1 !c 

< 2 1 X | pd+1.  Let  K = 2 1 X I pd  +1.  UH 

The  following  two  lemmas  are  useful  in  establishing  the  validity  of  the 
term  "variation  of  constants  formula"  as  regards  the  function  T. 

3.12  Lemma  Jor  ( r,  ,A  , f ) G WxA(,xC]  (a  ,b  ;Rn  ) , T ( £ ,f  ) i r,  t he  unique. 
solution  of  equations  (3.3),  (3.4)  with  g(t)  = (f(t),0)  and  s = a. 

Proof  Solutions,  if  they  exist,  are  unique  because  the  equation  is  linear 
and  its  homogeneous  part  has  unique  solutions. 

The  preceding  discussion  allows  us  to  conclude  that 

t 

V (t,u )r  y [v  (t  r(a),0)do 

io  ’ J ui  ’ 

r,.  °hserve  that  this 
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(jo(a-t)„,^  . , d)(a-t  ) , . u)(a-a),r,  . _ . , 

e V(  t ,a ) £ + e V(l:,a)e  (f(a),0)da 

a 

l 

(j)(  3“  t ) f \ _ . f . _ \ / r 1 _ \ n\  1..  I 


,|v(t,a)rJ  + | V(t,a)(f(o),0)dn 


= ew(a 


3.13  Lemma  For  (C,A,f)  G WxA  xC(a,b;R  ),  z(C,X,f)  is  a solution  of 


equations  (3.3),  (3.4)  with  g = (f,0)  and  s = a. 


Proof  By  Lemma  3.1the  function  s -*■  L(s,x^)  is  continuous  on  [a,b].  Since 
f is  also  continuous. 


lim  ( 1/e )[x( t+e )-x( t ) ] = lim  (1/e)  r L(s,x  )i f(s)]ds 
e-»0  \ 


- L.(  t ,xt ) + f ( t ) . 


Furthermore,  xG  L0(a-r,h)  implies  lim  (]/f:)|x  -x  J - ( x ) ^ in  L^  for 

e-K) 

all  t G [a,b]. 

We  are  now  in  a position  to  state  the  fundamental  result  of  this 


section.  Its  proof  follows  immediately  from  Lemmas  2.2,  3.12  and  3.13  and 
the  density  of  W x A^  x c in  Z x A x F.  An  important  implication  of  this 
theorem  is  that  the  map  f ->  z(?,A,f)  is  affine  and  compact  for  all  fixed 
(C,A)  G Z x A (see  Lemma  2.2).  This  fact  will  be  used  in  section  8. 


3.14  Theorem  The  solution  map  z(s,A,f)  and  the  variation  of  constants 
representation  ,('(^,X,f)  are  identical  on  Z*A*F. 


Theorem  3.15  below  provides  the  basis  for  the  approximation  scheme  to  be 


discussed  in  sections  4 through  8. 

3.15  Theorem  For  (t;,A,f)  G WxA  xF,  z(£,X,f)  is  the  unique  solution  of 
t 

y(t)  = x,  + j[ja/(s)y(s)  + ( f (s ) ,0 ) ]ds . 
a 

Proof  One  may  easily  show  that  for  (£,X,f)  G W x Ac  x p the  Function 
_Q?(  • )z(  r,  ,\ ,f )( • ) is  continuous  on  [a,b].  Hence  the  integral  exists. 

Using  the  definitions  of  and  z,  one  may  then  verify  that  z is  a 

solution  of  the  integral  equation.  Uniqueness  follows  from  Theorem  3.8.  //// 

We  emphasize  that  the  above  integral  equation  is  equivalent  to  equations 

(3.3),  (3.4)  with  g = (f,0)  only  if  f is  continuous. 

Finally,  we  remark  that  instead  of  using  the  FDE  theory  from  section  2 

to  show  that  the  IVP  of  equations  (3.1),  (3.2)  is  uniformly  correct,  we  could 
have  invoked  a result  of  Krein  [11,  Thm.  3.11,  p.  208]  after  our  Lemma  3.4. 

This  was  not  done  for  two  reasons.  The  first  is  that  some  material  required 
in  the  proof  of  Krein's  theorem  has  not  been  discussed;  the  second  reason 
is  that  properties  of  solutions  of  equations  (3.1),  (3.2)  imply  (once  one 

has  proved  uniqueness  of  solutions  of  equations  (2.1),  (2.?))  corresponding 
results  for  the  FDF  only  who??  (r;,X)  G WxA^.  Consequently  the  FPL  theory 
had  to  be  established  independently  in  or do?’  to  obtain  results  for  general 
( t,X ) G Z*A. 
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4.  Factor  Convergence  of  Solutions 


We  have  shown  (Theorem  3.15)  that  solving  the  equation 


y(t)  = C + f_c/(s;A)y(s)  + (f(sl,0)lds 


(4.1) 


is  in  many  cases  equivalent  to  solving  equation:;  ( ’.I),  ( ?.  ).  In  this 
chapter  we  present  a finite  difference  me t hod  which  loads  to  a very  conven- 
ient approximation  scheme  for  equation  (4.1)  ;this  method  may  easily  he  imple- 
mented on  a computer. 

Finite  difference  schemes  are  based  on  the  concept  of  factor  conver- 
gence; a good  introduction  to  this  idea  may  be  found  inKrein  [11,  ch.V],  Our 
scheme  is  essentially  the  same  as  that  developed  by  Krein,  although  the 
initial  formulations  differ  since  he  deals  directly  with  DDL  in  Banach  space. 

The  letter  N will  always  denote  a positive  integer; 
if  it  appears  as  a superscript  in  the  definition  of  a t<->rm.  It  will  be 
omitted  from  the  notation  when  no  confusion  will  result.  We  assume • further 
that  [a,b]  = [a,a+xr]  for  some  positive  integer  k.  More  will  be  said  in 
section  8 concerning  this  last  assumption. 
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Tor  a given  N,  partition  [a,b]  into  xM  subintervals  of  length  r/N 


N yj'l  N 

by  where  = a + ir/N.  The  approximation  scheme  is  suggested  by 


the  heuristic  argument: 


i-1  f i + 1 


y^t. ) = c + l 

i=0 


f_C^(s)v(s)  + ( f(s  ) ,0  ) Ids 


implies  that 


i-1 


y(t.)  - (r/N)  l .Of  A j)y(t.)  s ? + £ 

o rI  1 0 


i-1  f.i+i 


( f ( s ) , 0 ) ds , 


where  (v/N)q/^( i )y( t. ) approximates 


tj+l 


f D 

JJ^(t)y(t)dt  for  each  value  of  j. 


oome  preliminary  definitions  are  required  to  discuss  factor  convergence. 
For  a given  N,  let 


N ‘ N 

Z = XRn  with  inner  product  <•,•>„  = + (r/N)  \ <*,•>  , 

N « e i.  i.n  i nn 


xN 


F = X with  maximum  norm, 
0 


J.  = [-ir/N,  - ( i~ 1 )r/N ) for  j = i ,2 ,N, 


J0  = 


= [3+ ir/N,  a+(i+l)r/N)  for  i = 0 ,1,. . . ,kN-1  and 


kN 


(a+xr }. 
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Given  an  element  >f>  E l,?(-r,0;R  ),  lei 


*.  = (H/r)  j ♦(0)dO. 

J . 

1 


Let  EU  denote  the  Banach  space  of  functions  from  fa, hi  >c,  Z which  are 
N 

N ii 

uniformly  continuous  on  each  interval  K. , with  suprummn  norm  ]‘| 

1 ru 

ln 

Define  the  operators 

H (J 

ttn:  7 -*•  ZN  by  nN(n,t)  = (n , <f>  , • • • ) , and 


PfJ  * EN  +EW  by  PMy  = (V(1-0)’*”»V(,kN))* 


Note  that  I z £ I K | z and  |y|[;0  for  all  r,  G Z,  y £ E°. 


Now  define  the  operators 


V1;VZ  by  "n1 


N V = (vQ,  l V ch(J.,[-r,0])),  and 
1=1'’ 


KN 

Eff  fn  b>'  PfJ 1 w = l ch(Kj  ,[a,b]). 


Observe  that  Tt 


•1  -1 


N »PN  are  right  inverses  of  1fN ’Pj>j  respectively,  and  that 


r<  T’  P 


E C Ljj  for  all  N.  Note  also  that  in  general,  (p  w ) ( • ) is  not  continuous 
[a,bl,  so  y E does  not  imply  that  p^p  y t R. 

The  following  two  lemmas  show  us  the  sense  in  which  the  spaces  ZN»EN 
approximate  Z,  E respectively. 


4 . 1 Lemma  F or  all  £ £ Z , 
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iTjj  ->  r,  in  7,  as_  fl  ■>  ™. 


Proof  (see  [3  , Lemma  8.2])  This  is  easy  to  verify  by  computation  if  x,  - 

(n,*}1)  and  ]>  is  continuous.  Then  use  the  density  of  1 he  continuous  functions 

plus  the  linearity  and  uniform  equi continuity  of  the  maps  r -►  7r-^ir  r.  //// 

N N 


4.  2 Lemma  Tor  all  v f-  E 


lin,  | y - pjVI  = 0. 

Etl 


Proof  For  i = 0,l,...,rN  we  have  (p“  p y)(t)=i»^  "My(t  ) when  t G K..  Observe 

that  the  operators  converge  strongly  *o  the  identity  in  7 (Lemma 

M N 

4.  l) ; therefore  tt„  * f,  uniformly  with  res  poet  to  f in  the  compact  set 
M N 

(y(t):  t G [a,b])C  7.  This  fact  and  the  uniform  continuity  of  y imply  that 

(p^p^yKt)  converges  to  y(t)  uniformly  with  respect  to  t G [a,b],  //// 

oo 

If  (yH}H_1  is  a sequence  with  the  property  that  y G E^  for  all  N,  we 
say  that  {yfJ } factor  converges  to  y G E if 

lim  |pNy-yNlL.  = o. 

11*®  M 

Such  limits,  if  they  exist,  are  unique  by  Lemma  4.2. 

Let  y = (s,A,f).  Recall  that  by  Theorem  3.15,  7.  ( t , y ) = 

(x(  t ,a , y ) ,x^(  a,  y ) ) is  the  unique  solution  of  equation  (4.1).  Suppose  that 
there  is  a sequence  (7,j(y)}  which  factor  converges  to  ?..  For  each  N,  define 
x^(t)  = Xj^ftjy)  as  the  first  component  of  )( t) . The  significance  of 

factor  convergence  lies  in  the  fact  that  Lemma  4.2  implies 


lim  sup{  |x(  t)-x,.(  t ) | : t G [a,b]}  = 0. 
M-w* 


Therefore,  the  approximation  of  a solution  of  equation  (4.1)  in  fact  also 
yields  an  approximation  of  a solution  of  equations  (2.1),  (2.2). 


The  Approximation  Scheme 

Equation  (4.1)  may  he  rewritten  in  a more  convenient  form.  To 

this  end,  let  1 


Ew  = {z  E E:  '/( Or  W,  Vi  and  srfv.  ( E}, 


T = T(A):  E.^.->  E he  given  by 

t 

(Ty  )(t ) = y(t)  - /_C/(s  )y(s  )dr  , and 
a 


S:  W x F -*•  E be  given  by 

t 

S(£,f)(t)  = 5 + / (f(s),0)ds. 
a 


We  want  to  approximate  solutions  of 


Ty  = S(c,f). 


Therefore  consider  the  equations 


where 


1NyN 


PNqN^’f) 


kN 

E,.  = X Z with  inner  product 
N N 


(5.1) 


(5.2) 
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qN:  7,  x r ► 7^  x F is  riven  by 


q(/r,,f)  - (Titjr  ,(tl/r  ) ( f(s  ) ,0  )d-  ,...,( M/r  > | (f(s),0)ds). 


y 


o 


rfl-l 


SH:  7v  ' !'tl  * ,:'l  ir  rivrri  = <“o 


'V’i  = 


w + (r/V)  ) w. 

f)  | 


i - 0 


i - I ,r, . . . ,r!J, 


.1=1 


and  T Elt  -*  11,  approx i ma  1 es  T in  the  senna  to  he  described  below.  Observe 
N N N 

that  p,.S(^,f)  = SHq..(r,,f)  for  all  (t,f)€E  W*F  and  that  f,  ' oxis's  for  all  N. 

The  properties  of  the  operators  doternine  the  degree  of  success  of 
the  resulting  approximation  scheme.  To  illustrate,  it  is  quite  natural  to 
ask  that  T ^ exist  for  al]  N,  because  this  would  imnl.v  existence  and  unique- 
ness of  solutions  of  equation  ( 5 .2) . We  could  ask  further  tha*  the  condition 
pfJTy  = Tf[pNy  obtain  for  all  y,f!.  Tliis  would  imply  that  for  solutions  y,  yfJ 
of  equations  (5.1),  (5.2), 

pUy  = TN  rNPNV  = TM  ptlTy  = TN  pNS(?,f)  = T|I 


= yu 

for  each  If,  i.e.  immediate  factor  convergence.  the  first  requirement  is 
attainable  but  we  do  not  know  of  a scheme  which  satisfies  the  second 
requirement  for  general  X G A^. 

The  particular  definitions  now  given  lead  to  a scheme  which  has 
previously  been  studied;  more  will  be  said  in  section  lh  concerning  this. 
For  a given  N,  let 


£(*,N):  {0,1,. ..,v}  -*■  {0,1, ...,N)  be  such  that 


- t . E J. , . ,,  N for  all  i , 

] £(3,N)  j’ 


A(N, ' ) = A(M,  • ,1):  {0,l,...,icM-l}x{0,l,...,v}  > Rn"n  be 


given  by 


A(U,i,j)  = (H/r  )|  A . ( t )dt , 


D(H , • ) - D(N , * , X) : { 0 , 1 , . . . , kN-1  }x { 1 , ? , . . . ,fl } ► Rri  n be  given  by 


D(H,i,  j ) = (tl/r)  D(t,0)d0dt, 


K.  J. 
i 3 


L(N,*)  = L(N,  • ,x  ):  { 0, 1 , . . . ,kN-1  } ->  Rn)  be  given  by 

v N 

L(N,i)v  = l A(H,i,j)v  + (r/N)  £ D(N,i,i)v., 

j=0  ' 3 = 1 n 

= J3^(X):  (0,1, . . . ,KN-l)  £(Z^)  be  given  by 


(ja<.(i)v).  = 
N 3 


L(N,i  )v 


3 = 0 


(N/rHv.^-v.)  j = 1,2,.  ..,N, 


and  finally  let 


TN  = TN(A):  EN  EN  be  Rivfin  bv 


(V>i  = 


i = 0 


1-.L 

y.  - (r/H)  [ jarN(j)y  i = 1,2,...,*N. 

3=0 


Assuming  for  the  moment  that  T^1  exists,  define  Zf)  = T^S^U.f).  Then 


V - ZH  ’ V/VllVll7  - VW-0 


■ (Ti\»[si'T«V  - 


Hence  factor  convergence  is  established  once  we  demonstrate  that: 

(i)  sup{  |T„^Slt|  ..  r,  ,:  N=l, ?,...}  •'  "•  C 1 h > - is  known  as  stability 

" 1 ir  r 

of  the  difference  scheme)  and 

(ii)  lim  |s'1THp,.z-q,1(r„f)|  xr  = n (this  is  known  as  consistency  of 
N H N N /,NXfN 

the  difference  scheme). 


Stability  and  consistency  will  be  proved  in  sections  6 and  7 respectively. 

It  might  appear  more  natural  to  write  p^  z - = (T^ 1 )[TfJp1J7,-S)JqNC  r,  ,f ) ] 

and  establish  the  corresponding  stability  and  consistency  results.  However, 
we  have  been  unable  to  demonstrate  that  in  this  case  the  stability  condition 
obtains  for  general  systems. 

The  following  lemma  is  given  for  reference;  its  proof  is  straight- 
forward (use  induction  for  part  (i)).  Note  the  similarity  of  part  (iii) 
with  the  function  given  in  Krein  [11,  p.  342]. 


5.1  Lemma  With  as  above,  we  have: 
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n tn1:  en  en  given  by 


/ vr 


(Tnlv)i 


[ I+(r/N )a^j( 0 ) ]Vq  + (v^-Vq) 


i - 0, 
i = 1, 


i-1  i-2  , i-1 

JItI+(r/N W (j)]v  + l J H [I  + (r/N)j^  (;j)](v  -v 
j=0  u k=0lj=k+l  N k+i  h 


+ (v.-v.  ) 

l l-l 


i -2 , 3 , . . . ,kN ; 


iL ) SN1;  en  'v  Vfn  given  by 


(SN  V)i  = 


i = 0 


[ (H/r)(vi-v._1)  i.  = 1 ,2 , . . . ,kN; 


n-1 


iii}  VV  ZNxFH  EM  given  by 


[I  + (r/N)J3^(0)]vQ  + ( r/M)  v 


i = 0 


l = 


i-1  i-2r  i-1  . 

[ ntI+(r/N)ja^(j)]v0  + (r/N)  £ ( H ll  +(r/N )ja^(  j ) ] J 


k+1 


+ (r/N)v^  i - ?,3,...,kN; 


iy)  T^:  ■*  Riven  by 


i = 0, 


<V>i  = 


(N/r)(  v.-[  I + (r/N).9f  (i-l)lv.  .)  i = 
i rl  i-l 
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6,  Stability 

In  proving  that  the  desired  stability  condition  indeed  obtains,  we  find 
as  in  the  proof  of  Lemma  3.3  that:  it  is  more  convenient  to  work  in  certain 
spaces  with  equivalent  inner  product  topologies.  So  for  a given  N,  let 


k(*,N):  { 0 , 1 , . . . , N- 1 } ->•  {l,2,...,\>}  be  given  by 


k(j,N)  = min{k> 1 : -t,  6 U J.}, 

K • . , _ 1 

i=]+i 


e.  = b‘:u)  = ^ 


i = n 


1 + l | A I j = n , 1 , 2 , . . . , N-  1 , 

i=k( j ,N ) 1 c 


and 


N 

= = X R with  inner  product 

M 

<*.*>„  = <V>  + (r/N)  l B.  , 

YN  Rn  1 1~]  ' d" 


For  X €A  , define  M(X)  = (1+7^  I A . I )^2.  Observe  that  1 < 6^!  < M 2 ( X ) 
c ‘‘l'^'c  — 0 — 

for  all  N.  Thus  the  new  norms  satisfy 


Hz  i Hy  i M(x)|-|  . 

N YN  7U 


t'ne  purpose  for  these  rather  complicated  definitions  is  that  they  enable  us 
;n  the  proof  of  Lemma  6.2  below  to  write  for  v £ 
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Define  the  spaces 


kN 


= K(  A)  = XY  with  maximum  norm, 
N N N ’ 

0 


xN 

^ = JJ(X)  = XYh  with  inner  product 

tcN 

<*.*v  = (r/N)  l <•,•>  • 

~*N  1 YN 


Then 


Mr  i 1*1  w 1 H(X)|*|  , and 

N N N 


Ir  1 I'l  « 1 M(A)|  “ |r  • 

H N fN 


We  will  show  that 


suPf|TN1SH|^f(  „ : 11  = 1,2, ... } < », 


M N N 

which  will  yield  the  desired  stability  result. 

Lemmas  6.1  and  6.2  contain  the  crux  of  the  stability  argument,  which 

is  summarized  in  Theorem  6.3.  The  idea  of  defining  the  inner  product  used 

in  the  proof  of  lemma  6.2  was  motivated  by  a similar  definition  in  [16].  Define 

1/2 

the  symbol  p as  p = max{l,r  ). 

6,1  Lemma  Suppose  that  for  a given  A E there  is  an  a = a(A)  ■>  0 for 

which  max{  | I + (r/M)j^J(i)|  0<_i^»rll- 1 } <_  1 + «r/N. 

N 
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Then  there  is  a constant  6 = 6(A)  such  that  for  all  N, 


,THlsN^(YNxi ?n,Sfu)  ~ 6e° 


Proof  The  existence  of  such  an  a implies  that  for  all  N and  all  j , k with 
0 < k < j < <11-1, 


|HCl+(r/N)J^(i)]|^(Y  <_  eai<r. 

i=k  ' N 

Consequently  for  all  i = 0,1,...,<N  (see  Lemma  5.1  (iii)) 

I (TNlsNV)i  I Y + (r/N)  E I v i I Y } 

1 H N j=l  1 N 


<_  ?eniKr(  |v  |Y  + (<r)(r/N)  £ |v  . |y 

M j=l  1 N 

. 0 1/2  a<ri  | 

i 2*  pe  M v x fir  • 


2 .1/2 
V • 


6.2  Lemma  Given  A 0 A there  is  an  a = n( A)  for  which 

c 


max{|l+(r/N)_Q^(i)|  ^(y  y.  0<_i<WI-l  } <_  1 + ar/H. 


Froof  For  v 6 Yf  j , 


([I  + ( r/H)fl<I(i)Jv). 

11  k 


Vp  + (r/H)L(N,i)v  k = 0 


k = 1 ,2, . . .,N. 
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Hence , 


| ( [I+(r/N)_Q^I(i  )]v)Q  | n < |v0|  + (r/H)J  |A  J 


j ' c ' ' ( j , M ) 


+ (r/M)  l | P(M,i  , j ) | | v* . ( 
3 = 3 J 


i lv0l+(r/N)lA0lclv0l+(r/f')  I(ej_rBj)lvjl  + (r/w>lDlc|v,z 

1 N 


1 | v | +(r/N ){ | X | | v | + [((?.  | 

N 1 J J 3 


In  the  above  series  of  inequalities  we  have  used 


(r/N)  £ | D(N , i , j ) | | v . | _<  [(r/N)  [ | D(  N , i , j ) | 2]  1 17  | v | 


where 


N 7 " ?r  r 

(r/N)  l |D(N,i , j ) | = (r/N)  |(N/r)  D( t , 0 )dOdt | 

j=l  3=1  i J 

1 i 

1 (N/r)  I £ j | D(  t , 0 ) | 2d0dt 
K.  ^rl  J. 


1 3 


i M;. 


If 

Thus  letting  {•••}  = {|x|  |v|  + [(B.  -B.)|v.|),  we  have 

M \ 1 J :l 


|([I+(r/N)j^N(i)]v)0|?n  < | v0 | 2 + 2(r/N) | vQ | { — } + (r/M)?{ • • • }2. 

• • 2 2 

Using  the  inequality  2cd  <_c  +d',  vje  find  that  iho  middle  term  on  the 
right-hand  side  satisfies 

2(r/H ) I v0 1 ( * * * } = 2(r/H)C(2B0)1/2|v0|][ (]/?60)1/?{...)] 

<_  2B0(r/N)|v0|2  + ( 1 /2f?0  ) (r/tf ) { • • • }2. 


Observe  that 


< 2 | X | 2 1 v 

1?  + 
N 

’M 

:(PM‘ 

-yyi)2 

1 2|*|*|v 

* 

’ll 

(PM- 

) N 

-B.)  I [(B.  -p  - ) | v . | 2 
i > ^ i-i  .1  1 r 

(J 

1 2|x|2|v| 

+ 

2Ro 

— ■ C^J 
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1 

-B.)|v.|2. 

■1  1 1 V 

Recalling  that  6Q  > 1 , 

2(r/N)|  v0|  { — } <_  260(r/N ) | vQ  | 2+ 1 A | 2(r/N ) | v|  2 + (r/M )}( p } -P  . ) | v . | 2 

, , N _ 

1 (r/H)[2B  0+|xr]|v|;  +(r/H)£(B.  ,-B  : ) | v.  | ' 

M 1 J"1  J J 

and 

_ „ 
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( r/N ) 2 { • * • } ^ < (r/M)L2r|  A | 7 1 v|2  + ?(’.  Ivl'' 

— C Y 0 1 Y 

N II 


Consequently, 


| [I+(r/N)_Q/ (i  ) ]v|  2 <_  | v | 2+(r/N)[(  l + 2r ) | X | ' +4R  ] | v|  2 

1 m ^ c.  0 Y,, 


+ (r/N)  l(B  -B.)|v  |?  + (r/N)  [fi . .|v.  I2 
1 J -1  1 i 3"'  D-J 

1.  I v0 1 ‘ + (r/N)[(  l+2r)  |>  |c+5Bq  j|  v|  2 t(r/N)j8^. 


N 1 


( 1 + ar/N ) | v | 


0 o 

where  a = (l+2r)|x|  + 5H  (X).  Therefore 


|[I+(r/H)_Q^  (i)]v|  <_  (l  + ar/N)1/2|v|  < (1  + otr/H ) | v } . //// 

N YN  YN 


1.3  Theorem  Suppose  G C A is  such  that  sup{  |x | : X E G } < <®. 

-*•  c cl 


s UP  { | T (*)S  | y.  X6G  ; II  - ], 

K N N’  N 
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Proof  Note  that  sup(M(X):  X EG.)  < “ and 


sup { I tn  (x)snL^(yh* 3*(x),  ?n(x)):  x g fV  " r 


<_  sup{8(  X )e  X ^rr:  X E G } 


The  conclusion  follows  immediately. 


7.  Consistency 

As  usual,  for  y = (t;,X,f)  let  x = x(a,y)  denote  the  solution  of  equa- 
tions (2.1),  (2.2);  let  zf[  = z ( y ) = T,j ' ( X )SfJqt,(  t , f ) . Vie  shall  restrict 

our  attention  to  y E G,  where  G = {t}*G,xG  is  such  t h 1 * : r,  E W;  G C A 

12  1 c 

is  relatively  compact  in  ^ with  = sup{|x|^:  X E G ^ ) finite;  and  G^ C F 
is  bounded.  It  will  be  of  interest  later  to  know  that  { z,.  ( y ) } factor  con- 

H 

verges  to  z(y)  uniformly  with  respect  to  y E G (the  function  z was  defined 
in  section  2).  Thus  the  primary  result  of  this  section  is  the  statement  of 
Theorem  7.5  that  the  consistency  condition  is  fulfilled  uniformly  with  res- 
pect to  y E G. 

By  definition  of  the  operators  and  qfJ, 


CS^V„z(y>]i  = 


i = 0 


(N/r){  nNz(  t . ,y )-[  I+(r/M  ).cyfJ(  i - 1 ) |f^z(  t 1 ,y)  } 


i = 1,2,... ,kN, 
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V 


i = 0 


CqN(C,f)]i  = 


Hence,  defining 


(N/r  )j  (f(s),0)ds  i = 1,2,...,k!I. 
Ki-1 


g(N  ,y ) (i  ) = (r/H)[SH'1TIJp1Iz(y)-q1J(r,,f)L 


we  obtain 


i = 0 


g(N,y)(i)  = 


nNz(ti,Y)-{tI+(r/H)X/N(i-l)]nMz(ti_] ,y)+|  (f(s),0)ds} 


i-1 


.i  = 1,2,...,kH. 


Observe  that  g(N,y)(i)  €F  Z^;  let  g(N,y)(i,j)  denote  its  jth  component. 

Taking  advantage  of  the  representation  z(t,y)  = (x(t,a,y),x  (a,y)),  we 
find  that  for  j = 2, 3,..., I I 

g(N,y)(i,j)  = (ujjZft^y))^  - (nNz(t.._1,y)) 

= (xt  (a,y))'!  - (xt  (a,y))f! 
i J i-1  1 


= 0. 


The  terms  g(N,y)(i,j)  for  j = 0,1  must  be  analyzed  separately  and  in 
more  detail. 

7.1  Lemma  (i)  m?  = sup{ Jx^fa  ,y)  | : ( t ,y ) £ [a ,h >0 } is  finite; 

(ii)  f = sup{  |^-x(  • ,a,y)  |f  (a_r  ^ ^ : y£  G}  is  finite. 
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Proof  Let  = C.  Observe  that  |xa(a,y)|c  = for  all  y and  that 

sup{ |x(t;a,y) | : a < t < b,  yg  G)  is  finite  by  the  hypotheses  on  and 

Lemma  2.2,  Theorems  3.5,  3.14.  Consequently  x(y)  is  continuous  on  [a-r,b] 

and  bounded  uniformly  with  respect  to  y,  so  m^  is  finite.  Condition  (ii) 

1/2 

follows  from  the  relations  (recall  that p = max{l,r  }): 

|x(t)|  <_  p|x|c|xtlc  + | f ( t; ) I 

- pmTm2  + lf ^ '^1 

for  t (E  [a,b]  and  the  fact  that  for  all  y,  |x  (a,y)|  = |f>|  . I III 

* ''2  ,J2 

Define 

h(  i , y ) =||  |x(t,a,y)|2dt|1/,? 

Ki-1 

for  i = 1,2, .. . ,xN.  The  following  lemma  is  easily  proved  using  Holder's  in- 
equality and  the  definitions  of  g(N,y)(i,l)  and  h(i,yl. 

7«2  Lemma  sup{ | g(H,y )( i , 1 ) | : 1 <_i<_K N , y G 0}  <_  h(i  ,y  )(r/N) 1 


The  analysis  of  g(M,y)(i,0)  utilizes  the  following  elementary  result. 

7.3  Lemma  For  all  t,s€[a-r,b]  and  all  y€G  we  have  |x(t)-x(s)|< 

T | t-s  | ]//2.  Furthermore,  given  i 6 {],?,. i C { 1 ,2, . . . ,M}  and 
t G fa  + ( i-1 -j  )r/fl , a t (i+l-j)r/N|,  we  have 

|x(t,a,y)-(x  (a,y))t!|  2F(r/N ) 1 

l-l  3 
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Proof  The  first  statement  is  an  immediate  consequence  of L emma  7.1.  Let 
t = a + ( i - 1-  j ) r/N  and  o = I-t.  Then  o E l.0,2r/M  1 by  hypothesis.  Observe 
that 

it (r/N) 


|x(t)-(x  )r!|  = |x(t+o)  - (N/r)f  x(h)dh| 

l-l  3 1 


r/N 

= (N/r))[  [x(t+o  )-x(t+0  ) ]d0 


0 

r/N 


< (N/r) 


r I a-9  I 1/?df). 


r/N 


1/2. 


The  function  a -*■  j |o-0|  d9  assumes  the  maximum  value  of 
n/9  ®3/9  3/9 

(2/3)(2  -l)(r/N)  <_  2(r/N)  (when  a - 2r/N)  over  the  interval 

[0 ,2r/N ] . 


1111 


7.4  Lemma  For  all  y £G,  max{  |g(N,y)(i  ,0)  | : 1 < i < <N}  < 2Prm1(r/N ) 3/2 . 


Proof  Observe  that 


g(N,y)(i,0)  = x(ti)-{x(ti_])+(r/N)L(M,i-])nNz(ti_1)+J  f(t)dt} 

Ki-1 

= | [L(t,xt)  + f(t)]dt-(r/N)L(H,i-l  )irHz(tj  j )-J  f(t)dt 


Ki-l 


Ki-1 


Thus 
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|g(N,y)(i,0)|  = | [ ( A.(t)x(t-T.)+[  l [ D(t ,0)x(i+9)d0dt 

-i=0  ^ ' -1  -i:)  ' 

1 K.  , K.  -1  J. 

l-l  l-l  1 

- f A ( t.  )x(  1 . , )dt  - l | A.  (I  )(>:  )”  . Ht 

J 0 l-l  : _ l i I l , , U i,N) 

K.  . V . , 

1-1  1-1 

- | l | D(1.,0)(xt  ) jdOdt  | 

k.  , J . 1~1 

i-l  1 

lj  lA0l cl x< *- >-x(ti_1)ldi-+  J j |a.|c|x(i-t.)-(x1;>  )J(jiH)|dt 
Ki-i  Ki-.l 

f N 

+ I [ | H(t,0)  | | x.Ct+O  )-(x  )'.|dOdt 

J i=l  ti-]  1 

K.  , J J. 

1_1  v ° 

<_  2r(r/N)1/2|  l | A . | cdt  + | | | D(  t,0 ) | dGdt  J 


Ki-1  "r 


<_  2r(r/N)1/2{(r/lI)  \ |A^  + r1/2J  | D(  t ) | T dtj 

1 y 


1/0 

<_  2prm  (r/H)  . 


The  consistency  of  the  approximation  scheme  is  now  readily  established. 

7.5  Theorem  The  limit 

0 = lim  |s‘\pj,r.(Y)-q  U,f)|z 

n n n 

exists  uniformly  with  respect  to  y G G. 
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Proof  By  Lemmas  7.1,  7.2,  7.4  and  preceding  remarks, 

-1  .9  9 

lsN  TNpfJz(Y)-qNU,f)|;,  y},  = (r/H)  l (M/r)  |g(N,y)(i)| 


Ml 

= (H/r)  £ { |g(H,y)(i,0)|  + (r/M)  |p.(!J  ,y)(i  ) | ) 

i=l 


< (N/r)  l { ( 2p1'm  )2  ( r/H ) 3 t h2(  i , y ) ( r/H  Y } 


= icN(r/N)2(2pIm]  )2  + (r/tl) 


kN 

l 


I x ( * ) 1 d t 


£ (r/N)f2[  l+ifr(  2pm1  )2  ]. 


Therefore 


lSN  VHz(Y)“qM(C’f)lZ  xF  lm3(r/f,)  ’ 

N N 

2 1/2 

where  m^  = r[l+xr(2pmj)  ] is  independent  of  y E G. 


8.  Approximation  Under  More  General  Assumptions 

So  far,  we  have  relied  greatly  on  the  fact  that  X is  continuously  differ- 
entiable. As  we  shall  see  below,  the  preceding  results  enable  us  to  approximate 
solutions  of  equations  (2.1),  (2.2)  whenever  X G A is  essentially  bounded. 

Once  this  has  been  established,  we  may  deal  with  such  FDE  on  any  bounded 
interval  [a,b]  by  simply  extending  X and  f as  zero  to  the  interval  [a,a+xr] 
for  an  appropriate  integer  k. 


A = L (a,b;(X  RnXn)  * L_(a,b;  Rn*n)) 

oo  oo  ’ 7 2 

o 
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with  norm  Using  a standard  result  [12,  corollary,  p.  208]  one  can 

prove  that  for  every  X E there  is  a sequence  {i|i  } in  A^  of  step  (i.e. 

finitely-valued)  functions  which  converges  to  X in  the  A norm,  and  is  such 

that  1^1^  2 | X | ^ for  all  i.  E'rom  {i/n}  one  can  construct  a sequence  { X ^ } 

in  A having  the  same  properties,  i.e.  I X . -X  I ► 0 and  for  all  i,  I X . I < 
o 1 l c — 

2 1 X | . 

I I 00 

Suppose  ( £ , X , f ) G WvA  *T  ir,  riven;  let  (X.)  he  ,i.  ul>-'vo  and  define 
Y>  Y^  (i  = 1,2,...)  as  (r,X,f  ),  (^,X^,f)  respectively.  Then  the  set  G = 
U{y.}  satisfies  the  standing  assumption  of  section  7,  hence  also  the  hypo- 
theses of  Theorems  6.3  and  7.5.  Therefore 

lim  |p  z(yn)-z  (y.,)L  = 0. 

N 11 

Note  that  z(yN)  converges  to  z(y)  in  E hv  Lemma  2.2.  Consequently 
(zN(yN)}  factor  converges  to  z(y),  since 

IPNz(y)"WIe  - lz(Y)"z(YN)|E  + Ipnz(y„)-7.n(yn)|e  . (8.1) 

N N 

Assume  now  that  f,  f.  6 F (i  = 1,2,...)  and  { f . } — * f ; redefine  y^  as 

Then  Lemma  2.2  and  Theorem  3.14  in  conjunction  with  the  above 

reasoning  and  standard  inequalities,  imply  that,  once  again  { ( y N ^ ) factor 

converges  to  z(y).  This  fact  will  be  used  in  the  proof  of  Lemma  lo.l. 

Since  we  are  primarily  concerned  with  the  computational  aspects  of 

this  theory,  it  is  of  interest  to  Know  how  the  operators  J3k^(Xn)  relate  to 

To  this  end,  let  r be  chosen  so  that  2r„  is  the  smallest  posi- 
n vo 

tive  number  representable  in  the  language  to  be  used  on  a given  computer 
(e.g.  2Cq  = 16  ^ in  double  precision  FORTRAN  on  IPM  360,370  machines).  If 
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in  addition  to  the  above  requirements  on  X^  we  ask  that  |X-X^|  £ 
eQmin{(r/N)1/,2,r/N},  then  for  all  j,  k,  N: 

|A(N,j,k,X)-A(N,j,k,X(J)|  £ (H/r)1/?|X-X([|  < tQ,  and  I 

|D(N,j,k,X)-D(H,j,k,XH)|  < (N/r)|X-XH|  < r0. 

Thus  the  machine  representations  of  .fjOX  ) and  _C3^j  ( X ) are  identical. 

Observe  from  Lemmas  7.1  and  7.4  that  the  rate  at  which  {p  z(y^)  - 

ZH ( YN ) ) ^actor  converges  to  zero  is  determined  by  m^m^  an<^  bound  in  F 

on  (f . }.  The  overall  rate  of  factor  convergence  of  z (y  ) to  z(y)  depends 
£ il  N 

also  (see  equation  (8.1))  on  the  rate  of  convergence  in  E of  z ( ) to  z(y), 
which  in  turn  depends  on  the  particular  sequences  {X^}  and  { f ^ } . 
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9.  The  Control  Problem 

Having  seen  that  solutions  of  equations  (2.1),  (2.2)  may  be  approximated 
by  solutions  of  the  difference  equations  (5.2),  we  proceed  to  deal  with  an 
associated  optimal  control  problem,  which  will  be  denoted  as  (i?).  We  replace 
the  inhomogeneous  term  f appearing  on  the  right-hand  side  of  equation  (2.1) 
with  the  product  Bu,  where  B (E  Lm(a,b;Rn  m)  and  u £ L^tajbjR  ). 

Throughout  this  chapter  we  shall  use  the  letter  x to  denote  a solution 
of  equations  (2.1),  (2.2).  For  a given  N , the  symbol  zN  will  denote  a solution 
of  equation  (5.2);  the  symbol  x^  will  denote  the  corresponding  first  component 

of  p„'*'z„  (see  section  4). 

N N 

Let  U denote  the  space  of  control  functions,  L^(a,b;Rm).  Assume  that 
functions  g^:  Z*F  -*■  R and  g^:  U -*■  R have  been  defined  and  that  a subset 
of  U has  been  specified.  Define  the  cost  functional  $:  '/&'  -*•  R by 


4>(u)  = gj  (z(b,a,£,A  ,Bu),x(  • ,a,c,A  ,Bu))  +g?(u). 

The  optimization  problem  is 
(jj^):  Minimize  <J>  over  9/. 

Problem  (.^)  is  tractable  under  the  hypotheses  given  below.  We  need 
the  concept  of  quasiconvexity  for  the  statement  of  these  hypotheses.  A 
real-valued  function  h defined  on  a convex  set  is  quasiconvex  (see  [4  , 
section  5])  if 

h(au+(l-a)v)  < max{h(u) ,h(v) ) 


r mm 

49 

for  0 < a < 1 and  all  u,  v.  If  strict  inequality  obtains  for  0 < a < 1 and 
u 4 v,  h is  strictly  quasiconvcx.  Equivalently  (se"  (6  , Defn.  1.5.2]),  h is 
quasiconvex  if  the  set  {u:  h(u)<ct]  is  convex  for  all  real  numbers  a. 

• We  assume  throughout  that: 

(Hi)  is  closed  and  convex; 

(H2)  is  continuous  (i  = 1,2); 

(H3)  g^  is  quasiconvex  (i  = .1,2);  and 

(H4)  a)  is  bounded,  or 

b)  (i)  g^  is  bounded  below  (i  = 1,2), 

(ii)  g2  is  radially  unbounded  (i.e.  g2  ■*  » as  |u|  ->  °°), 

(iii ) the  mappings  Q”1  and  the  sets  (defined  in  section  10 

below)  satisfy  C ^ for  all  N. 

Other  than  (H4b)(iii),  the  above  hypotheses  are  standard  in  control  theory. 

From  Lemma  2.4  we  see  that  the  maps  u ->  z(b,a,C,A ,Bu)  and 
u -*■  x(  • ,a, £ ,X ,Bu)  are  affine  and  continuous.  Consequently  4>  is  continuous 

and  quasiconvex;  4>  is  strictly  quasiconvex  if  g?  is.  By  Mazur's  theorem 
(see  [12,  p.  85]),  the  set  ^ is  weakly  closed.  This  theorem  also  implies 
that  <J> , being  lower  semicon tinuous  and  quasiconvex,  is  weakly  lower  semi- 
continuous. 

Let  the  sequence  {u^}  be  such  that  4>(u..)  -*■  a = inf{4>(u):  u £0*}. 
Hypothesis  (H4)  implies  that  {u^}  is  a bounded  sequence.  Hence,  there  is  a 
weakly  convergent  subsequence  let  u"  denote  its  weak  limit.  Clearly 
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a < $>(u")  < lim  inf  Mu....)  = a. 
~ - i(]) 


Therefore,  problem  (j?)  has  a solution.  The  optimal  control  is  unique  if  we 
assume  that  $>  is  strictly  quasiconvex. 

As  in  section  8,  no  problem  is  encountered  in  extending  the  interval 
on  which  solutions  of  equation  (2.1)  are  to  be  defined.  In  particular,  if 

we  extend  A and  u as  zero  ov^r  some  interval  lb,a+Kr),  then  z(  f ) = z(b) 
for  b <_  t a+icr.  Thus  only  trivial  adjustments  need  he  made  in  defining 
a new  cost  functional,  for  this  reason  we  assume  henceforth  with  no  loss 
of  generality  that  b-a  = rr  for  some  integer  r. 


10.  The  Approximate  Control  Problems 

We  now  associate  cost  functionals  <l>  with  equations  (5.2)  in  such 

a way  that  the  resulting  optimization  problems,  donoted  (9^*)  , reflect. 

several  properties  of  problem  (^).  To  this  end,  define 

rM  icll 

l),,  = X P with  inner  product  <■,*>  = (r<'tll  ) 

N i , 

Let  denote  the  map  from  U into  given  by 

Q^u  = ((N/r )j  u(t)dt,  ...,  (H/r)l  u(f)dr) 

K K 

0 kM-1 

Observe  that  |Qjjl^(u  y ^ 1 for  all  M.  Define  a right  inverse  Q”^  : 

of  Qn  by 

*cN-l 

qm1v  = J Vi+1  chtKj.ta.b]). 
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(Recall  that  similar  definitions  we re  made  in  section  M ) . 

Define  - Q ^ . Let:  t : -*•  R be  given  by 

N N N H 


We  define  the  approximate  optimization  problems  as 
: Minimize  over 

V 

We  could  have  defined  as  a function  from  to  R,  However,  this  would  have 
changed  the  nature  of  from  that  of  a classical  mathematical  programming 

problem  to  an  optimization  problem  over  an  infinite-dimensional  control  space. 

Since  the  maps  v •>  (p^1zN)(c,X,BCT1v)(b)  and  v xN(^,X,BQ"1v)(  • ) 
are  affine  and  continuous  (obvious  from  Lemma  5.1  (iii))  for  each  N,  each 

<J>  is  a continuous  and  quasiconvex  function  over  the  closed  convex  set  t2q,. 

Using  arguments  similar  to  those  employed  in  section  9,  we  may  conclude  by 
hypothesis  (114)  that  for  each  N there  is  a solution  uj-'j  G ^\\  of  problem 
(_Q^^)^.  Observe  that  is  strictly  quasiconvex  if  g9  is,  in  which  case 
u*  is  unique. 

Suppose  for  the  moment  that  the  following  results  have  been  established: 


10.1 

Lemma 

If 

Qn]un^u,  then  <t>(u)  < lim  inf  $ (uN>. 

10.2 

Lemma 

If 

Qfl 1 UN  ’+  U*  then  = lim 

10.3 

Lemma 

For 

all  u EU,  Qj^^QjjU  u. 

10.4 

Lemma 

Suppose  (v  } is  bounded  in  U and  v„  -^v.  Then  Q-1Q  v v 

n N N N N 

k - J 
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For  each  N,  let  uj'j  denote  a solution  of  problem  The  follow- 

ing lemma  is  instrumental  in  estab lishing  the  relationship  between  problems 
(9)  and  W9\. 

10.5  Lemma  The  sequence  Q„^u"  is  bounded  in  U. 

N N 


Proof  The  result  is  simple  to  establish  if  is  bounded  (pick  a sequence 

{v,.}  in  such  that  Q,,v„  = u:'i;  use  equiboundedness  of  the  linear  functions 
N N N N 

u -*■  Q^^Q^u).  Otherwise  (cf.  [2,  section  4]),  choose  an  arbitrary  u E 
Then  for  all  N, 


'VUN)  - 'VQNu)‘ 


Lemmas  10.2  and  10.3  imply  that  the  right-hand  side  converges  to  'Hu).  Thus, 
the  sequence  { ♦ C vi* ) } is  bounded,  which  implies  by  (H4b)(ii)  that  {Q^u*} 
is  also  bounded.  //// 

no 

Let  ( un( i ) Ji- 1 c*enot:e  a subsequence  of  {u*}  having  Uic  property  that 
the  sequence  } is  weakly  convergent  in  I);  lei  n*  denote  its  weak 

limit. 

Since  u*  is  a natural  candidate  for  a solution  of  problem  (9),  we 
must  consider  whether  it  is  an  element  of  <2'.  Lemma  10.5  and  hypothesis  (H4) 
ensure  that  a bounded  sequence  {v  } exists  in  ^ with  the  property  that 
^N(i)Vi  = UN(i)  ^°r  ^ ’ bet  v be  b^e  wea^  limit  of  the  weakly  convergent 

subsequence  {v^^};  since  ‘2'  is  weakly  closed,  v E Lemma  10.4  implies  that 

QN(i(j))UN(i(  j))  ^V*  Hence  u*  because  Q^.)U*(i)  -^u*  implies  that 


v. 


10.6  Theorem  The  above  u*  is  a solution  of  problem  (0*).  Furthermore, 

*(u*>  = lim  ♦ri(i)(uH(i))* 

Froof  For  all  uG  f we  have  by  Lemmas  10.1,  10.2  and  10.3 
$(U")  1 lim  inF  %(i)(uN(i)) 

1 S”P  ^N(i)(uN(i)) 

< lim  sup  Vi)(QtI(i)u) 

= $(u).  //// 

Under  assumption  of  strict  quasiconvexity,  a standard  argument  involv- 
ing subsequential  limits  implies  that  this  u*  is  the  unique  solution  of 

problem  (£?*)  and  that  Q“1u*  -^-u*. 

N N 

So  far,  we  have  not  exploited  the  finite-dimensionality  of  . 

Indeed,  we  shall  not  explicitly  do  so.  This  aspect  of  the  approximate 
optimization  problems  is  important,  however,  because  it  permits  us  to 
develop  computational  packages  without  introducing  further  approxi  mat  ions. 

An  example  of  a control  set  satisfying  hypothesis  (H4b)(iii)  is  given 
below.  Control  sets  of  this  type,  and  those  satisfying  hypothesis  (F4a), 
are  commonly  used  in  optimization  problems. 

Let  X be  a closed  convex  (unbounded)  subset  of  . Define  the  set 


9/  = (u:  u(t)  E X a.e.  on  [a,b]}. 
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Clearly,  ^satisfies  hypothesis  (Hi).  We  employ  a standard  argument  using 
the  Hahn-Banach  theorem  to  demonstrate  that  “^satisfies  hypothesis  (H4b)(iii) 
as  well.  In  particular,  for  u G^and  i = 0 , 1 , . . . ,icN-l  let  y^  = y^(u)  = 

(N/r)  u(t)dt.  Suppose  that  y.  for  some  i.  Then  there  exist  c G R, 

J K 1 


£ G Rm  such  that  c < ^ and  sup{£^v:  vG  X}  < c.  Therefore,  c < ?^y^  = 


(N/r) 


rT 
£ u 

K 


(t)dt  < c,  a contradiction, 


We  now  supply  proofs  for  lemmas  10.1,  10.2,  10.3  and  10.4. 


Proof  of  Lemma  10.1  Our  remarks  in  section  8 imply  that  z.,(u,T)  factor 
N N 

converges  to  z(u).  Observe  that  for  all  y G E^, 


sup{ | (p“  y ) ( t ) | z : t G [a ,b] } = |y  f E . 
Using  these  facts  and  Lemma  4,2,  we  find  that 


lim  sup{|(pN  z^j ) ( t )-z(  t ) I ^ : t *=  Ca,b]}  = 0. 
N 


Therefore(pN1zNXc,A,BQ'1uN)(b  ) a-  z(b,a,£  ,A,Bu)  and  xNU,A  ,BQ^1u[( )(  • ) 

->  x(-  ,a,s,A,Bu)  in  Z and  F respectively.  The  conclusion  follows  from  the 
continuity  of  g^  (hypothesis  (H2))  and  the  weak  lower  semicontinuity  of  g^ 


(hypotheses  (HI),  (H2)  and  Mazur's  theorem). 


//// 


Proof  of  Lemma  10.2  This  follows  immediately  from  hypothesis  (H2)  and  the 

convergence  of  (p„^z„.)(k)  to  z(b)  and  x„(  • ) to  x(  • ) as  above.  //// 

N N N 

Proof  of  Lemma  10.3  This  may  be  proved  in  exactly  the  manner  in  which  Lemma 


4.1  was  established. 


//// 
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”1  “1 

Proof  of  Lemma  10.4  For  all  w G U we  have  (Q^  Qnvj^»w)  = (v[,j>w)  - (v^w-Q^ 
since  for  u^  ,u2  G U we  have  (QjjJ"Qnu1,U2^  = ^ui’^N^NU2^*  The  conclusion 
follows  from  Lemma  10.3.  //// 

11.  Description  of  Numerical  Techniques  Employed 

In  our  discussion  of  numerical  results,  we  shall  not  explicitly  consider 
the  effect  of  round-off  error.  Our  intention  is  not  to  imply  that  it  is 
negligible,  but  to  emphasize  the  particular  characteristics  of  the  approximation 
scheme  presented  in  section  5.  In  this  regard,  note  our  comments  in  section  13 

A 

concerning  the  chemostat  example  (for  N = 32). 

The  finite  difference  scheme  was  used  in  the  manner  described  below  to 
compute  solutions  of  problems  (see  section  10).  Its  implementation  was 

easy;  in  fact,  the  only  further  approximations  required  arose  in  the  evaluation 
of  A(N,i,j)  and  D(N,i,j)  (see  sections  4,5).  A standard  quadrature  algo- 

rithm, exact  for  four th-order  polynomials,  was  employed  for  this  purpose. 

Since  O.-Or.^w  = w.  for  each  w G , the  set  of  admissible  controls  for  each 
vh  N II 

approximate  problem  was  readily  characterized. 

The  difference  equations  for  the  state  and  (see  [13  sec.  VII. 4])  auxil- 
. iary  equations  were  solved  exactly.  Numerical  solutions  of  problems  Cq/^)jj 

were  obtained  by  a combination  of  the  gradient  and  conjugate  gradient 
techniques.  In  particular,  for  a fixed  N,  a gradient  step  was 
taken  on  the  first,  fourth,  seventh,  etc.  iteration,  with  conjugate  gradient 
steps  in  between.  This  procedure  was  continued  until  a convergence  criterion 
for  the  values  of  was  satisfied. 

L. 
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Several  optimization  problems  governed  by  autonomous  systems  (namely 
examples  1,  2 and  3 of  [3])  were  solved  numerically  both  by  the  technique 
described  above,  denoted  as  method  R,  and  its  analog  (see  [3])  for  the  method 
of  Banks  and  Burns,  denoted  as  method  B.  In  each  case  the  results  were 
compared  to  an  exact  solution.  As  expected,  low-order  (i.e.  N = 4,  8) 
approximations  with  method  R were  not  very  accurate.  The  results  were  better 
for  intermediate  values  of  N (i.e.  16,  32)  and  quite  good  for  large  N 
(i.e.  64,  128) 

Generally  speaking,  comparable  accuracy  was  obtained  by  taking  N twice 
as  large  for  method  R as  for  method  B.  The  definite,  and  not  surprising, 
advantage  of  method  R is  its  faster  execution  on  a computer.  Evaluating  on 
this  basis,  methods  B and  R are  roughly  equivalent.  Consider  example  4.3  of  [3]: 
method  B required  about  32  seconds  to  execute  with  N = 16,  while  method  R 
required  17  seconds  with  N = 32.  Method  B was  only  slightly  more  accurate. 

12.  Results  for  a Simple  Nonautonomous  System 

We  now  present  an  example  for  which  numerical  and  analytical  solutions 
were  readily  obtained.  These  solutions  were  used  to  evaluate  the  accuracy 
of  the  above  finite-difference  scheme. 

Consider  the  system 

x(t)  = 6tx(t-] ) + u(t  ) t G To,?!, 

( x( 0 ) , Xq ) = (1,1), 

ry 

and  associated  optimization  problem  (.&):  minimize  4>(u)  = (1/2)  x (2)  + 

2 2 

(1/2)/  u (t)dt  over  the  set  - L (0,2;R). 

0 2 

__ A 


An  analytical  solution  v/as  obtained  in  the  following  manner  by  means  of 
necessary  conditions  on  extremal  pairs  (see  [13,  section  VII. 2]).  It  is  easy 
to  verify  thaf  this  problem  is  normal,  so  for  an  extremal  pair  (x*,  u*)  there 
is  a function  if  G L^(0,3;P.)  such  that 

t G (2,3] 

t = 2 

and  on  [0,2],  >f(t)  = -P(  t+  1 )if(  t+  1 ) . Furthermore , u*  sa  t isf  i es  the  pointwise  max- 
imum principle: 

<f(t){6tx*(t-l)  + u*(t)>  - (l/2)[u*(t)]2  = 

max(if(t){6tx*(t-l)  + v]  - (l/2)v2} 
v gr* 


*(t)  = 


-x:':(  2 ) 


Therefore  u*  = if. 

Letting  if (2)  = n,  we  find  that 


u*(t)  = if(t) 


r 


-3ot  t 


2 


-f>at+10a 


< 


a 


t G L o , I ] , 
t G [1,21. 


This  in  turn  implies  that 


x*(t) 


' 3 2 

-at  + 3(l-a)t  + lOat  +1  1 G [0,1], 

(-1.2a)t5  + (4.5)t4  + (26a-12)t3  + (12-36a)t2 


+ at  + ( 16 . 2a-0 . 5 ) 


t G [1,2]. 
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Using  the  fact  that  -a  = x*  ( 2 ) , we  obtain  a = -22 . 5/»»U . 8. 

Since  we  know  a priori  that  problem  if?)  has  a unique  solution 

(section  9),  these  necessary  conditions  imply  that  it  is  given  by  (x",u*)  as 

defined  above.  Consequently  the  optimal  cost  is  riven  bv 

2 • 

2 '■> 

<J>*  = ( 1/2 ) [x:; ( 2 ) J + (1/2)  Cu*(t)]‘di 

0 

= (1/2)44. 8«2 

= (23.5)2/89.6 
= 6.1635. 

Selected  values  of  $*,  u*  are  given  in  Table  I. 

We  have  computed  numerical  solutions  of  the  corresponding  ['roblems 
for  N = 4,  8,  16,  32,  64  and  128.  A summary  of  the  results  is  included  in 
Table  I.  Observe  that  in  this  example  the  quantities  ir(J(x(0 ) ,x0 ) , A(N,i,j) 
and  D(N,i,j)  were  computed  exactly.  In  particular, 

n^(x(0  ) ,Xq  ) = (1, !,...,?)  V H, 


A(N,i, j ) 


0 j = 0 and  all  II,  i, 

(6i+3)/M  j = v = 1 and  all  N,  i. 


D(N ,i , j ) = 0 


VN,  i, 


The  same  general  behavior  is  observed  for  this  example  as  for  the  autono- 
mous systems  discussed  above.  In  comparing  the  approximate  solution  for 
N = 128  to  the  analytical  solution,  we  see  that  the  relative  error  in  the 
control  values  is  less  than  2%,  except  at  time  0.75  where  it  is  about  3%.  The 
relative  error  in  the  pavoff  (for  N = 128)  is  less  than  0.2"i. 


TABLE  I : NONAUTONOMOUS  EXAMPLE 
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13.  The  Chemostat  - a Biochemical  System 

In  this  section  we  present  numerical  results  for  an  optimization  problem 
based  on  the  dynamics  of  the  chemostat.  This  device  controls  the  growth  of 
a microorganism  population  by  regulating  the  supply  of  one  essential  nutrient, 
while  providing  all  other  nutrients  in  excess.  Equations  (13.1),  (13.2)  below  are 

similar  to  models  of  the  chemostat  which  have  appeared  in  the  literature  (see 
t 5] , [ 17] ) . The  nonlinearities  in  these  equations  are  analogous  to  those 
appearing  in  the  initial  velocity  approximations  (usually  associated  with  the 

names  of  Henri,  Michaelis-Menton,  and  Briggs-Haldane)  which  are  used  to  model 

enzyme  catalyzed  reactions  (see  [1,  Ch.  1]). 

Let  x and  s represent  the  microorganism  population  density  and  nutrient 

concentration  in  the  growth  chamber,  respect  i vely.  Let  t tie  state  of  the  system 

2 

be  given  by  (x,s)€E  C(-l,3;  R ).  Then  we  have 

0 

V]X(t)  / s(  t v-0  )y(  0 )d0 

x(t)  = ^ - D(t)x(l)  <GIO,3j,  (13.1) 

K + / s( ttO  )y( 0 )d0 
-1 

V x(t)s( t ) 

s(t)  = D(t)[s0-s(t)3  - ^ +-s(tj~  t€[0,3],  (13.2) 

where  s^  denotes  the  nutrient  concentration  in  the  incoming  medium,  D(t)  the 
washout  rate,  K the  saturation  constant  for  the  rate  of  uptake  of  nutrient, 
the  maximum  growth  rate,  and  the  maximum  uptake  ratn.  The  function 
y £ Ljt-^O;  R)  is  used  to  weight  the  distributed  effect  of  the  nutrient  con- 


centration on  the  growth  rate. 
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In  the  case  to  be  considered  below,  we  made  no  attempt  to  assign  physi- 
cally meaningful  values  to  the  above  constants;  rather,  we  arbitrarily  set  the 
values  sQ  = 2,  K = 1,  V1  = 1,  = 1/2,  and  defined  y(0)  = 1,  0 G [-1,0]. 

The  optimization  problem  (SP)  was  formulated  as  follows.  A control 
D G L2(0,3;  R)  was  employed  to  force  the  system  away  from  an  initial  steady 
state.  The  system  was  then  linearized  about  the  resulting  trajectory, 
denoted  as  z - ((x(t),xf),  (s(t),s^))  G C(0,3;  R‘  1 ,0 ; R2)).  The  cost 

function  4>:  “2^=  L^fO,!;  R)  -*■  R was  defined  as 

2 3 3 

$(u)  = 5 J | z(  t ) | ?dt  t 50  j |z(t)-[z(2)-z(t)  1|  'dt  t r'j|u(t)|?dt 
0 2 0 

t 50|z(3)-[z(2)-z(3)ll2, 

where  z = (x-x,s-s)  and  u = D-D  represent  the  state  and  control  functions 
respectively  for  the  linearized  system.  This  particular  definition  of  4>  was 
motivated  by  the  objectives: 

(i)  keep  z and  u small  along  the  trajectory,  so  that  the  lineariza- 
tion is  fairly  accurate;  and 

(ii)  force  (x,s)  to  the  new  steady  state  (x(t),s(t))  = (x(?),s(2)), 
t G [2,3]. 

We  have  computed  numerical  solutions  for  the  corresponding  problems 
for  N = R,  16  . A summary  of  the  results  is  included  in  Table 
II.  The  magnitude  of  xjj(t),  s*(t)  for  t G [0,2]  and  for  each  value  of  N is 
less  than  0.1,  except  for  x'"(1.75)  and  x*(7.0).  These  magnitudes  are  less 


than  0.2. 
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TABLE  II:  CHKM05TAT  MODI: Ij 


N 

4 

8 

16 

*N 

0.2022 

0.2283 

0.2407 

TIME 

U4 

U8 

U 16 

0.0 

0.0004 

0.0673 

0.0614 

0.25 

-0.0166 

0.0077 

0.0171 

0.5 

-0.0286 

-0.0215 

-0.0020 

0.75 

-0.0390 

-0.0376 

-n.oi 15 

1.0 

-0.0501 

-0 .0492 

-0.0188 

1.25 

-0.0619 

-0.0617 

-0.0304 

1.5 

-0.0738 

-0.0756 

-0.0482 

1.75 

-0.0849 

-0.0897 

-0.0697 

2.0 

-0. 1617 

-0.1533 

-0.1220 

2.25 

-0.1605 

-0.1862 

-0.1871 

2.5 

-0.1278 

-0. 1667 

-0. 1832 

2.75 

-0.0870 

-0.1244 

-0. 1481 

3.0 

-0.0870 

-0. 1012 

-0. 1 116 

TIME 

x*-x 

xr* 

X16^ 

2.0 

0. 1312 

0.0991 

0.0892 

2.25 

0.1022 

0.0673 

0.0565 

2.5 

0.0856 

0.0490 

0.0382 

2.75 

0.0761 

0.0364 

0.0237 

3.0 

0.0727 

0.0268 

0.0084 

TIME 

s*-S 

S*-l 

S16“® 

2.0 

-0.0686 

-0.0434 

-0.0225 

2.25 

-0.0538 

-0.0278 

-0.0056 

2.5 

-0.0455 

-0.0200 

0.0018 

2.75 

-0.0410 

-0.0160 

0.0047 

3.0 

-0.0400 

-0.0147 

0.0053 

— 
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The  runs  displayed  in  Table  II  required  much  more  time  to  execute  than 
those  appearing  in  Table  I..  A rough  estimate  (exact  figures  are  not  available) 
of  the  total  CPU  time  required  for  N = 4,  8,  16  is  420  seconds.  A run  was 
made  with  N = 32.  Numerical  errors  appear  to  have  become  significant  here,  for 
the  CPU  time  required  to  meet  the  convergence  criterion  was  greater  than 
expected  and  the  results  differed  slightly  from  what  had  been  anticipated 
(based  on  an  examination  of  earlier  runs). 

The  rather  lengthy  execution  times  for  this  example  show 
that  batch  processing  is  advisable  in  some  cases.  The  program  loaded  into 
less  than  256  K bytes  of  storage,  and  used  five  disk  files  with  total  length 
under  90  K bytes. 


14.  Concluding  Remarks 

The  theory  we  have  presented  generalizes  the  work  of  Banks  and  Burns 
(see  [2],  [3])  on  autonomous  systems  in  two  ways: 
i)  nonautonomous  systems  are  treated,  and 
ii ) the  approximating  systems  are  governed  by  difference , as  opposed 
to  differential,  equations. 

The  primary  practical  advantage  of  (ii)  is  that  it  leads  directly  to  algorithms 
which  may  be  implemented  on  a computer,  whereas  the  theory  developed  in  [2], 

[3]  requires  a numerical  approximation  of  the  approximating  ODE  systems. 

The  use  of  averaging  approximations  in  the  study  of  hereditary  systems 
is  not  at  all  new.  For  a detailed  bibliography  and  commentary  on  the  literature, 
we  refer  the  reader  to  section  5 of  [3]. 

As  mentioned  earlier,  the  approximation  scheme  discussed  in  section  5 
has  previously  been  studied.  Delfour  [7]  investigated  its  convergence  and 


applicability  to  the  linear  quadratic  optimization  problem.  The  techniques 
he  employed  are  substantially  different  from  those  we  have  chosen.  For 
purposes  of  comparison  we  shall  use  our  notation  to  briefly  describe  his  work. 
(The  symbol  A^  below  denotes  a space  similar  to  our  A^. ) 

Delfour  defines  piecewise  constant  Rn-valued 
functions  by  means  of  the  solutions  of  the  difference  equations  obtained 
from  the  first  component  of  equations  (5.2).  These  functions  are  shown 
[7,  Propx.  3.2]  to  converge  in  the  supremum  norm  to  the  solution  of  equations 
(2.1),  (2.2).  Having  asserted  [7,Thm.  2.1]  equivalence  of  equations 
(2.1),  (2.2)  and  the  corresponding  abstract  ODE  in  Z for  (c,A,f)(E  W x A°  x F , he 
restates  [7,  prop.  3.4]  the  approximation  results  in  operator  notation  in 
spaces  similar  to  Z^.  Corresponding  theorems  are  presented  for  solutions 
of  the  adjoint  and  Riccati  equations,  which  lead  to  his  treatment  of  the 
optimal  control  problem. 

The  major  difference  between  Delfour' s approach  and  that  represented 
by  [2],  [3]  and  our  own  efforts  is  that  (for  the  linear  regulator  problem) 

Delfour  approximates  not  only  the  state  equation  in  Z,  but  the  infinite- 
dimensional adjoint  and  Riccati  equations  as  well.  The  method  of  [2],  [3] 
and  this  investigation  involves  immediate  approximation  of  the  state  equation  in  Z 
by  a finite-dimensional  problem  (either  an  ODE  or  difference  equation)  and 
then  employment  of  standard  numerical  methods  to  solve  the  approximate 
problem. 
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